Appl.No. 10/016,941 

Amdt, dated January 3, 2008 

Reply to Office Action of October 3. 2007 

Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 
Listing of Claims : 

1 (currently amended). A method of presenting information regarding a video 
comprising a plurality of frames comprising: 

(a) summarizing a video, said summarization comprising a plurality of 
segments of said video^ based upon an event characterized by a semantic 
event that includes a sports play, where each of said segments includes a 
plurality of sequential frames of said video; 

(b) displaying said summarization in a first portion of a display; and 

(c) displaying a graphical user interface on a second portion of said display, 
said interface sequentially indicating the relative location of each of said 
plurality of segments within said sunmiarization relative to at least one other 
of said segments as each of said plurality of segments is displayed, each of 
said plurality of segments represented by a bounded spatial region on said 
fifst second portion of said display; 

(d) displaying to a user said relative location for a first semantic 
characterization of a said sports play in said video using a first visual 
indication and displaying said relative location for a second semantic 
characterization of a said sports play in said video using a second visual 
indication different from said first visual indication; and 

(e) receiving from said user, by interaction with said graphical user interface, a 
selection of one of said plurality of segments; and 

(f) in response to said selection, presenting a selected one of said plurality of 
segments and not presenting at least one other of said plurality of segments. 

2 (previously presented). The method of claim 1 wherein said first and second semantic 
characterizations of a said sports play temporally overlap in said summarization. 
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3 (Original). The method of claim 1 wherein said graphical user interface includes a 
generally rectangular region where each of said plurality of segments is indicated within said 
generally rectangular region. 

4 (Original). The method of claim 1 wherein the size of each of said plurality of 
segments is indicated in a manner such that said plurality of segments with a greater number of 
frames are larger than said plurality of segments with a lesser number of frames. 

5 (Original). The method of claim 4 wherein the size of the regions between each of said 
plurality of segments is indicated in a manner such that said regions between with a greater 
number of frames are larger than said plurality of segments with a lesser number of frames. 

6 (previously presented). The method of claim 4 where said user selects one of said 
plurality of segments by interacting with said graphical user interface at a point within the 
displayed bounded spatial region associated with the selected one of said plurality of segments. 

7 (previously presented). The method of claim 6 wherein presentation of a selected one 
of said plurality of segments begins at the first frame of said segment irrespective of which point 
within said displayed bounded spatial region that said user interacted with. 

8 (Canceled). 

9 (previously presented). The method of claim 6 wherein presentation of a selected one 
of said plurality of segments begins at a frame of said segment temporally corresponding to the 
point within said displayed bounded spatial region that said user interacted with. 

10 (previously presented). The method of claim 6 including a selector by which said user 
may alternatively select a chosen one of (i) presentation of a selected one of said plurality of 
segments beginning at the first frame of said segment irrespective of which point within said 
displayed bounded spatial region that said user interacted with; and (ii) presentation of a selected 
one of said plurality of segments beginning at a frame of said segment temporally corresponding 
to the point within said displayed bounded spatial region that said user interacted with. 
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1 1 (previously presented) The method of claim 7 including a user-moveable scroll bar on 
said graphical user interface indicating the relative temporal location of currently-presented 
frames of said summary, wherein said user selects one of said plurality of segments by moving 
said scroll bar over the selected one of said plurality of segments, and where said scroll bar snaps 
to the beginning of the selected one of said plurality of segments. 

12 (Original). The method of claim 1 wherein at least two of said plurality of segments 
are temporally overlapping. 

13 (Original). The method of claim 12 wherein said temporally overlapping segments are 
visually indicated in a manner such that each of said overlapping segments are independently 
identifiable. 

14 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments. 

15 (Original). The method of claim 14 wherein said one of said plurality of segments is 
the segment most temporally adjacent to said portion of said video. 

1 6 (Original). The method of claim 14 wherein said one of said plurality of segments is 
the next temporally related segment. 

17 (Original). The method of claim 14 wherein said one of said plurality of segments is 
the previous temporally related segment. 

1 8 (Original). The method of claim 1 wherein a user selects a portion of said video 
included within said plurality of segments, wherein in response thereto, said system presents said 
portion of said video from the start thereof. 

19 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
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within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments. 

20 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments starting from the begirming thereof. 

21 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents said 
selected portion not included within said plurality of segments, and wherein after presenting said 
selected portion not included within said plurality of segments presents said selected plurality of 
segments in temporal order without portions of said video not included within said plurality of 
segments, and wherein said user selects a portion of said video included within said plurality of 
segments, wherein in response thereto, said system presents said portion of said video within said 
plurality of segments. 

22 (Original). The method of claim 1 wherein said temporal information is hierarchical 
and is displayed in such a maimer to retain a portion of its hierarchical structure. 

23 (Original). The method of claim 1 wherein said temporal information relates to 
overlapping time periods and said temporal information is displayed in such a manner to 
maintain the differentiation of said overlapping time periods. 

24 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein the temporal information is presented in a plurality of layers in a 
direction perpendicular to the length of said time line. 

25 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein textual information is included within said time line. 
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26 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein additional textual information is displayed upon selecting a portion of 
said time line. 

27 (Original). The method of claim 1 wherein said temporal information is displayed 
together with a time line, wherein additional textual information is displayed together with 
selecting a portion of said time line. 

28 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein additional audio annotation is presented upon presenting a portion of 
said time line. 

29 (Previously presented). A method of presenting information regarding a video 
comprising a plurality of frames comprising: 

(a) identifying a plurality of different segments of said video, where each of 
said segments includes a plurality of frames of said video; 

(b) displaying, simultaneously with a said segment of said video, a graphical 
user interface including information regarding the temporal location of a 
said segment relative to at least one other of said segments of said video; 

(c) displaying in an interactive display said temporal location for a first 
semantic characterization of an event in said video using a first visual 
indication and displaying said temporal location for a second semantic 
characterization of an event in said video using a second visual indication 
different fi-om said first visual indication; 

(d) displaying to a user at least one selector by which said user may interact 
with said interactive display to select for viewing selective identified ones of 
said plurality of segments; 

(e) receiving user-selections of identified ones of said plurality of segments; 
and 

(f) presenting user-selected ones of said plurality of different segments. 
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30 (Original). The method of claim 29 wherein said graphical user interface includes a 
generally rectangular region where each of said plurality of segments is indicated within said 
generally rectangular region. 

3 1 (Original). The method of claim 29 wherein the size of each of said plurality of 
segments is indicated in a manner such that said plurality of segments with a greater number of 
frames are larger than said plurality of segments with a lesser number of frames. 

32 (Original). The method of claim 31 wherein the size of the regions between each of 
said plurality of segments is indicated in a manner such that said regions between with a greater 
number of frames are larger than said plurality of segments with a lesser number of frames. 

33 (Original). The method of claim 29 further comprising an indicator that indicates the 
current position within said temporal information of a currently displayed portion of said video. 

34 (Original). The method of claim 33 wherein said indicator changes location relative to 
said temporal information as the portion of said currently displayed portion of said video 
changes. 

35 (Canceled). 

36 (Original). The method of claim 29 further comprising 

(a) indicating with an indicator the current position within said temporal 
information of a currently displayed portion of said video; and 

(b) modifying the position of said indicator within said temporal information 
which modifies the displayed portion of said video. 

37 (Original). The method of claim 36 wherein said indicator is modified to a portion of 
said video that is not included within said plurality of segments. 

38 (Canceled). 

39 (Original) The method of claim 29 wherein at least two of said plurality of segments 
are temporally overlapping. 
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40 (Original). The method of claim 39 wherein said temporally overlapping segments are 
visually indicated in a manner such that each of said overlapping segments are independently 
identifiable. 

41 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments. 

42 (Original). The method of claim 41 wherein said one of said plurality of segments is 
the segment most temporally adjacent to said portion of said video. 

43 (Original). The method of claim 41 wherein said one of said plurality of segments is 
the next temporally related segment. 

44 (Original). The method of claim 41 wherein said one of said plurality of segments is 
the previous temporally related segment. 

45 (Original). The method of claim 29 wherein a user selects a portion of said video 
included within said plurality of segments, wherein in response thereto, said system presents said 
portion of said video from the start thereof. 

46 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments. 

47 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments starting from the beginning thereof 
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48 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents said 
selected portion not included within said plurality of segments, and wherein after presenting said 
selected portion not included within said plurality of segments presents said selected plurality of 
segments in temporal order without portions of said video not included within said plurality of 
segments, and wherein said user selects a portion of said video included within said plurality of 
segments, wherein in response thereto, said system presents said portion of said video within said 
plurality of segments. 

49 (Original). The method of claim 29 wherein said temporal information is hierarchical 
and is displayed in such a manner to retain a portion of its hierarchical structure. 

50 (Original). The method of claim 29 wherein said temporal information relates to 
overlapping time periods and said temporal information is displayed in such a manner to 
maintain the differentiation of said overlapping time periods. 

51 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein the temporal information is presented in a plurality of layers in a 
direction perpendicular to the length of said time line. 

52 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein textual information is included within said time line. 

53 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein additional textual information is displayed upon selecting a portion of 
said time line. 

54 (Original). The method of claim 29 wherein said temporal information is displayed 
together with a time line, wherein additional textual information is displayed together with 
selecting a portion of said time line. 
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55 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein additional audio annotation is presented upon presenting a portion of 
said time line. 

56 (Currently Amended). A method of presenting information regarding audio 
comprising: 

(a) identifying a plurality of different segments of said audio, where each of 
said segments includes a temporal duration of said audio; 

(b) displaying simultaneously with said segment of said audio a graphical user 
interface including information regarding the temporal location of a said 
segment relative to at least one other of said segment of said audio; 

(c) displaying in an interactive display said temporal location for a first 
semantic characterization of an event in said audio using a first visual 
indication and displaying said temporal location for a second semantic 
characterization of an event in said audio using a second visual indication 
different from said first visual indication; 

(d) displaying to a user at least one selector by which said user may interact 
with said display to select for listening vi e wing selective identified ones of 
said plurality of segments; 

(e) receiving user-selections of identified ones of said plurality of segments; 
and 

(f) presenting user-selected ones of said plurality of different segments. 

57 (Canceled). 

58 (Original). The method of claim 56 further comprising 

(a) indicating with an indicator the current position within said temporal 
information of a currently displayed portion of said audio; and 

(b) modifying the position of said indicator within said temporal information 
which modifies the displayed portion of said audio. 
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59 (Original). The method of claim 58 wherein said indicator is modified to a portion of 
said audio that is not included within said plurality of segments, 

60 (Original). The method of claim 56 wherein at least two of said plurality of segments 
are temporally overlapping. 

61 (Original). The method of claim 60 wherein said temporally overlapping segments are 
visually indicated in a maimer such that each of said overlapping segments are independently 
identifiable. 

62 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments. 

63 (Original). The method of claim 62 wherein said one of said plurality of segments is 
the segment most temporally adjacent to said portion of said audio. 

64 (Original). The method of claim 62 wherein said one of said plurality of segments is 
the next temporally related segment. 

65 (Original). The method of claim 62 wherein said one of said plurality of segments is 
the previous temporally related segment. 

66 (Original). The method of claim 56 wherein a user selects a portion of said audio 
included within said plurality of segments, wherein in response thereto, said system presents said 
portion of said audio from the start thereof 

67 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said audio included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said audio within said plurality of segments. 
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68 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said audio included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said audio within said plurality of segments starting from the beginning thereof. 

69 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plurality of segments, wherein in response thereto, said system presents said 
selected portion not included within said plurality of segments, and wherein after presenting said 
selected portion not included within said plurality of segments presents said selected plurality of 
segments in temporal order without portions of said audio not included within said plurality of 
segments, and wherein said user selects a portion of said audio included within said plurality of 
segments, wherein in response thereto, said system presents said portion of said audio within said 
plurality of segments. 

70 (Original). The method of claim 56 wherein said temporal information is hierarchical 
and is displayed in such a manner to retain a portion of its hierarchical structure. 

71 (Original). The method of claim 56 wherein said temporal information relates to 
overlapping time periods and said temporal information is displayed in such a manner to 
maintain the differentiation of said overlapping time periods. 

72 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein the temporal information is presented in a plurality of layers in a 
direction perpendicular to the length of said time line. 

73 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein textual information is included within said time line. 

74 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein additional textual information is displayed upon selecting a portion of 
said time line. 
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75 (Original). The method of claim 56 wherein said temporal information is displayed 
together with a time line, wherein additional textual information is displayed together with 
selecting a portion of said time line. 

76 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein additional audio annotation is presented upon presenting a portion of 
said time line. 

77 (Original). The method of claim 29 wherein a user selectable skip function skips a set 
of frames to a modified location of said video in at least one of a forward temporal direction or a 
reverse temporal direction, and displays said video at said modified location. 

78 (Original). The method of claim 29 wherein a user selectable skip function skips to a 
later temporal segment or a previous temporal segment, and displays said video at said later 
temporal segment or said previous temporal segment, respectively. 

79 (Original). The method of claim 29 wherein a user selectable scan function skips a set 
of frames to a modified location of said video in at least one of a forward temporal direction or a 
reverse temporal direction, and displays said video at said modified location, and thereafter 
automatically skips another set of frames to another modified location of said video in at least 
one of said forward temporal direction or said reverse temporal direction, and displays said video 
at said another modified location. 

80 (Original). The method of claim 79 wherein at least one of said forward temporal 
direction and said reverse temporal direction are consistent with said different segments. 

81 (Original). The method of claim 80 wherein said display of said video is at the start of 
the respective one of said different segments. 

82 (Previously Presented). The method of claim 80 wherein said display of said video is 
at a predetermined offset within the respective one of said different segments. 

83 (Previously Presented). The method of claim 29 wherein said graphical user interface 
displays a respective image associated with at least a plurality of said different segments. 
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84 (Previously Presented). The method of claim 82 wherein said respective image 
associated with the currently presented said different segments is visually highlighted. 

85 (Previously Presented). The method of claim 83 wherein during presentation of said 
video said visually highlighted respective images are said highlighted in a substantially regular 
interval while the sequence of said presentation of said video is at substantially irregular 
intervals. 

86 (Previously Presented). The method of claim 56 wherein the presentation of said 
different segments may be modified by a plurality of different functions, and wherein the user 
may customize another function, not previously explicitly provided, by combining a plurality of 
said plurality of different functions into a single function. 
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